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CIRCUIT AND METHOD FOR INTERLEAVING A DATA STREAM 

Background of the Invention 

5 The present invention relates in general to 

integrated circuits, and more particularly to 
integrated circuits for interleaving data contained in 
different sections of a multimedia data stream. 

Digital Versatile Disks and other devices are 

10 frequently used to store video and audio, i.e., 

multimedia, data for displaying on a monitor or driving 
speakers. The multimedia sounds and images typically 
are intended to be produced at the same time, but the 
data used to generate them may be provided serially. 

15 Therefore, it is often necessary to interleave 

data contained in different sections of the serial data 
stream to allow the different sections to be processed 
together. For example, in the multimedia formatting 
standard known as the Motion Picture Expert's Group 1 

20 (MPEG-1) standard, the audio portion includes data for 
two audio channels, i.e., stereo, which are interleaved 
within each frame of the incoming data stream and can 
readily be processed together. An extension of MPEG-1 
referred to as the MPEG-2 standard expands this concept 

25 to include additional channels of surround sound 

capability to provide up tp eight channels of audio 
data. To ensure backward compatibility with the 
earlier MPEG-1 standard, MPEG-2 provides stereo data 
within one section of the data stream and surround 

30 sound data within a different section which is received 
later . 

Prior art audio processing circuits use a large 
memory circuit with up to 26,000 memory cells to store 
the audio data stream from the stereo section up to and 
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including the surround sound data. To avoid 
interrupting the output signal due to data not being 
available, the memory circuit is configured as a dual 
port memory which can be written to and read from 
5 simultaneously. However, such dual port memories 

consume a large die area on an integrated circuit and 
therefore increase the manufacturing cost of the 
processing circuit . 

Hence, there is a need for an improved circuit and 
10 method of retaining data from one section of a 

multimedia signal so that the data can be processed 
together with data from another section that is 
received later in a serial data stream. 

15 Brief Description of the Drawings 

FIG. 1 is a diagram of a frame of MPEG-2 audio 

data; 

FIG. 2 is a block diagram of a multimedia data 
20 processing circuit; and 

FIG. 3 is a block diagram of an audio processor. 

Detailed Description of the Drawings 

25 A simplified frame of a typical audio portion of 

an MPEG-2 data stream is shown in FIG. 1, including a 
stereo section containing control information in HEADER 
1 along with stereo data for stereo CHANNELS Tl and T2 . 
The stereo section is followed by a surround sound 

30 section containing control information in HEADER 2 

along with surround sound data for CHANNELS T3, T4 and 
T5 . Because the stereo and surround sound output 
signals are intended to be heard at the same time, they 
must be processed together, even though surround sound 
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data is received later than stereo data. Moreover, the 
processing must occur continuously and without pauses 
to provide high quality audio output signals to drive 
the speakers or other output devices. 
5 FIG . 2 is a block diagram of a multimedia data 

processing circuit 10 for converting a multimedia data 
stream DATA to a video signal for driving a monitor 22 
or other display device, and an audio signal for 
driving a speaker 24 or other audio device. To 

10 simplify the description, data processing circuit 10 is 
shown as having one speaker, although there typically 
is one speaker for each channel of audio data produced 
by data processing circuit 10. DATA is compressed and 
formatted in accordance with the Motion Picture 

15 Expert's Group 2 (MPEG-2) standard as shown in FIG. 1. 

Multimedia data processing circuit 10 includes a 
data flow circuit 26 which receives DATA in serial 
fashion on a 32-bit input bus 30 from a Digital 
Versatile Disk or other input device. DATA is sorted 

20 into video and audio portions which are stored in 

serial fashion in separate regions of a buffer storage 
circuit 28, which includes a large dynamic random 
access memory (DRAM) to store several frames of data. 
Data flow circuit 2 6 tracks the locations of the video 

25 and audio regions with pointers to control and monitor 
transfers of DATA on a 32-bit data bus 38 in response 
to memory requests from a video processor 34 and an 
audio processor 3 6 sent on a control bus 40. 

Video processor 34 receives the video portion of 

30 DATA from buffer storage circuit 28 on a thirty-two 

bit bus 38 for decompressing and other video processing 
such as color correction, pixel interpolation, etc. 
Where the monitor is configured to receive an analog 
video signal, video processor 34 includes circuitry to 
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convert the digital video data to an analog video 
signal and to amplify the analog video signal . 

As video data is processed and the video image is 
displayed on monitor 22, a request for new data is sent 
5 to data flow circuit 2 6 on bus 40. However, data flow 
circuit 26, buffer storage circuit 28 and bus 38 are 
not always available to respond to such requests 
immediately to ensure a continuous and uninterrupted 
supply of video data to video processor 34. For 

10 example, data flow circuit 26 and/or bus 38 may be busy 
performing other system tasks such as receiving new 
DATA, transferring audio data to audio processor 3 6 or 
communicating with other system devices (not shown) 
coupled to bus 38. To avoid interruptions in the video 

15 output signal that drives monitor 22, video processor 
34 includes local memory to absorb such periods when 
data is not immediately available to allow video 
processing to continue for a time. 

Similarly, audio processor 36 decompresses the 

20 audio portion of DATA received from data flow circuit 
26 on bus 38. Audio data is formatted to include 
surround sound audio channels, so audio processor 36 
interleaves stereo channels T1-T2 with surround sound 
channels T3-T5 to drive speaker (s) 24. Audio processor 

25 34 includes circuitry to perform a digital-to-analog 

conversion on the audio data and to amplify and filter 
the converted analog audio signal if necessary. 

As audio data is processed, audio processor 36 
issues a request for new data to data flow circuit 26 

30 on control bus 40. As is the case with video data, if 
data flow circuit 2 6 and/or bus 38 are occupied with 
other system tasks, new audio data often is not 
immediately transferred on demand. To ensure that 
speaker 24 is driven with an uninterrupted audio 
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signal, audio processor 36 includes local memory to 
store enough audio data to ensure continuous processing 
for the periods when data flow circuit 2 6 and bus 38 
are unavailable to transfer new audio data. 
5 While data for one circuit is being transferred so 

that data flow circuit 26, buffer storage circuit 28 or 
bus 38 are busy, other circuits must wait until the 
transfer is complete. Hence, the size of the local 
memory in video processor 34 and audio processor 36 is 

10 determined by the amount of data transferred to other 
circuits. To reduce wait states, local memory 
typically is configured as dual port random access 
memory. However, dual port random access memory 
consumes a large area on an integrated circuit die and 

15 consequently increases system cost, so it is desirable 
to either reduce the size of data transfers or to 
reduce the amount of local memory needed to absorb the 
wait states. 

FIG • 3 is a schematic diagram showing further 

20 detail of audio processor 34 for decoding and 

processing audio data received on bus 38 to produce a 
continuous audio signal to drive speaker 24. Audio 
processor 34 includes memory circuits 62 and 64, a 
memory control circuit 66, a multiplexer 68, a 

25 decompression circuit 70 and audio circuitry 72. 

Memory circuits 62 and 64 are configured as dual 
port memories capable of providing stored data to their 
respective outputs while receiving and writing new data 
from bus 38. Memory circuits 62 and 64 have adequate 

30 storage capacity to absorb the worst case wait states, 
i.e., to retain enough data to ensure continuous audio 
processing while waiting for new audio data to be 
received. Stereo data (T1-T2) from buffer storage 
circuit 2 8 is routed through memory circuit 62 and 
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surround sound data (T3-T5) is routed through memory 
circuit 64. Since this data is available in buffer 
storage circuit 28, it can be transferred in small 
packets as it is processed, rather than as a complete 
5 frame. By using two memory circuits 62 and 64 and 
avoiding the need to store an entire frame of audio 
data, the present invention can use smaller memory 
circuits than the prior art. 

For example, in the described embodiment, memory 

10 circuits 62 and 64 include about 1,000 bits of storage 
capacity, a significant reduction from the 26,000 bits 
needed by the prior art. The smaller memory size 
significantly reduces die area and circuit 
manufacturing cost . 

15 Memory control circuit 66 controls data transfers 

into and out of memory circuits 62 and 64 with 
read/write lines 80 and 82. Memory control circuit 66 
includes a pointer to monitor the amount of stereo data 
currently stored in memory circuit 62, which is 

20 incremented when new stereo data is received and 

decremented when data is provided at the output of 
memory circuit 62 and selected through multiplexer 68. 
A similar surround sound pointer tracks the amount of 
surround sound data currently being stored in memory 

25 circuit 64. The surround sound pointer increments and 
decrements when surround sound data is transferred into 
or out of memory circuit 64, respectively. When the 
amount of data stored in memory circuits 62 or 64 falls 
below a predetermined level, memory control circuit 66 

30 sends a request on bus 40 to data flow circuit 26 for 
new stereo or surround sound data. 

Multiplexer 68 selects between memory circuit 62 
and memory circuit 64 in response to a selection signal 
from decompression circuit 70 to produce an interleaved 
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signal at its output. By way of example, suppose that 
decompression circuit 70 needs a packet of T1-T2 data 
followed by a packet of T3-T5 data to decompress the 
audio data stream. Decompression circuit 70 produces a 
first selection signal at the control input of 
multiplexer 68 to route a T1-T2 packet stored in memory 
62 to the output of multiplexer 68. Decompression 
circuit 70 then produces a second selection signal to 
route a T3-T5 packet stored in memory 62 to the output 
of multiplexer 68 in a sequence T1-T2, T3-T5, etc. 
Hence, a T1-T2 packet is interleaved with a T3-T5 
packet . 

Stereo and surround sound data typically are 
selected and decompressed in packets according to the 
algorithm used in decompression circuit 70, rather than 
as individual alternating bits. Therefore, data stored 
in memory circuit 62 may be processed at a different 
rate from data stored in memory circuit 64. As stereo 
or surround sound data is selected through multiplexer 
68, decompression circuit 70 sends a control signal to 
memory control circuit 66 to decrement the appropriate 
pointer to update the amount of data currently stored 
in memory circuits 62 and 64. 

In this fashion, decompression circuit 70 
decompresses the audio data to provide a decompressed 
audio data stream at output 84. The decompressed audio 
data stream is applied to audio circuitry 72 for 
further processing such as decoding into the two stereo 
and three surround sound channels, converting to analog 
audio signals, amplifying, filtering and the like. The 
five-conductor output of audio circuitry 72 drives 
speaker 24 and/or other audio devices (not shown) . 

By now it should be appreciated that the present 
invention provides a circuit and method of interleaving 
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a data stream in which the data to be interleaved is 
contained in separate sections of the data stream. A 
buffer storage circuit receives and stores the data 
stream. A first section of the data stream is 
5 transferred to a first memory circuit and a second 

section of the data stream is transferred to a second 
memory circuit. A multiplexer circuit having first and 
second inputs respectively coupled to the outputs of 
the first and second memory circuits selects between 
10 the first and second sections of the data stream in 
response to a selection signal to produce an 
interleaved output signal. 
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CLAIMS 

What is claimed is: 

5 1, A circuit for interleaving a data stream, 

comprising : 

a buffer storage circuit having an input coupled 
for receiving and storing the data stream; 

a first memory circuit having an input coupled to 
10 an output of the buffer storage circuit for receiving a 
first section of the data stream; 

a second memory circuit having an input coupled to 
the output of the buffer storage circuit for receiving 
a second section of the data stream; and 
15 a multiplexer circuit having first and second 

inputs respectively coupled to the outputs of the first 
and second memory circuits for selecting between the 
first and second sections in response to a selection 
signal to provide an interleaved output signal at an 
20 output. 

2. The circuit of claim 1, wherein the first and 
second sections of the data stream are representative 
of different channels of an audio signal. 

25 

3. The circuit of claim 1, wherein the first and 
second sections of the data stream are formatted as an 
audio portion of Motion Picture Experts Group 2 (MPEG- 
2) data. 
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4. The circuit of claim 1, wherein the first 
memory circuit includes a dual port memory for 
providing stored data at the output of the first memory 

5 circuit while receiving and storing other data from the 
buffer storage circuit . 

5. The circuit of claim 4, wherein the second 
memory circuit includes a dual port memory for 

10 providing stored data at the output of the second 

memory circuit while receiving and storing new data 
from the buffer storage circuit. 

6. The circuit of claim 1, wherein the first 
15 memory circuit has a control input responsive to a 

first control signal for receiving first data from the 
buffer storage circuit after an amount of data stored 
in the first memory circuit falls below a predetermined 
value . 

20 

7. The circuit of claim 6, wherein the second 
memory circuit has a control input responsive to a 
second control signal for receiving second data from 
the buffer storage circuit after an amount of data 

25 stored in the first memory circuit falls below a 
predetermined value. 

8. The circuit of claim 7, further including a 
memory control circuit having first and second outputs 

30 coupled to control inputs of the first and second 
memory circuits for providing the first and second 
control signals, respectively. 
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9. A method of interleaving a data stream, 
comprising the steps of: 

storing the data stream; 

copying a first section of the data stream to a 
first memory location; 

copying a second section of the data stream to a 
second memory location; and 

selecting between the first and second memory 
locations to produce an interleaved output signal. 

10. The method of claim 9, wherein the step of 
storing includes the step of storing data of the first 
section of the data stream and data of the second 
section of the data stream in a third memory location. 

11. The method of claim 10, wherein the step of 
selecting includes the step of selecting between data 
stored in the first memory location and data stored in 
the second memory location. 

12. The method of claim 11, wherein the step of 
selecting further includes the step of selecting first 
data from the first memory location while transferring 
second data from the third memory location to the first 
memory location . 

13. The method of claim 12, wherein the step of 
selecting further includes the step of selecting third 
data from the second memory location while transferring 
fourth data from the third memory location to the 
second memory location. 
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14. The method of claim 11, wherein the step of 
selecting the first data includes the steps of: 

transferring data from the third memory location 
to the first memory location in response to a first 
control signal ; and 

incrementing a first pointer representative of an 
amount of data stored in the first memory location. 

15. The method of claim 14, wherein the step of 
selecting the first data further includes the steps of: 

decrementing the first pointer as data stored in 
the first memory location is selected; and 

generating the first control signal after the 
first pointer decrements to a first predetermined 
value . 

16. The method of claim 15, wherein the step of 
selecting the second data includes the steps of: 

transferring data from the third memory location 
to the second memory location in response to a second 
control signal; and 

incrementing a second pointer representative of an 
amount of data stored in the second memory location. 

17. The method of claim 16, wherein the step of 
selecting the second data further includes the steps 
of: 

decrementing the second pointer as data stored in 
the second memory location is selected; and 

generating the second control signal after the 
second pointer decrements to a second predetermined 
value . 
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18. The method of claim 9, wherein the data 



streamis representative of a multimedia signal. 




5 



19. An integrated circuit, comprising: 
a buffer storage circuit having an input coupled 



for receiving and storing a multimedia data stream; 

a first memory circuit having an input coupled to 
an output of the buffer storage circuit for receiving a 
first section of the multimedia data stream; 



the output of the buffer storage circuit for receiving 
a second section of the multimedia data stream; and 

a multiplexer circuit having first and second 
inputs respectively coupled to the outputs of the first 
15 and second memory circuits for selecting between the 
first and second sections in response to a selection 
signal to provide an interleaved output signal at an 
output . 

20 20. The integrated circuit of claim 19, further 

including a memory control circuit having first and 
second outputs coupled to control inputs of the first 
and second memory circuits to receive data from the 
buffer storage circuit after an amount of data stored 

25 in the first or second memory circuit falls below a 
predetermined value. 



10 



a second memory circuit having an input coupled to 
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CIRCUIT AND METHOD FOR INTERLEAVING A DATA STREAM 
Abstract of the Disclosure 

5 A circuit and method of interleaving a data stream 

(DATA) in which the data to be interleaved is contained 
in separate sections of the data stream. A buffer 
storage circuit (28) receives and stores the data 
stream. A first section (T1-T2) of the data stream is 

10 transferred to a first memory circuit (62) and a second 
section (T3-T5) of the data stream is transferred to a 
second memory circuit (64) . A multiplexer circuit (68) 
receives data from the first and second memory circuits 
and selects between the first and second sections of 

15 the data stream in response to a selection signal to 
produce an interleaved output signal. 
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